(19) 



J 




(12) 



(43) Date of publication: 

07.10.1998 Bulletin 1998/41 

(21) Application number: 98102523.2 

(22) Date of filing: 1 3.02.1 998 



Europaisches Jij|ntann 
European Pate^Hfice 
Office europ6endes brevets (H) EP 0 869 641 A2 

EUROPEAN PATENT APPLICATION 

(51) Int. Cl.«: H04L 12/433. H04L 12/437 



(84) Designated Contracting States: 

ATBECHDEDKESnFRGBGRIEITLILUMC 

NLPTSE 

Designated Extension States: 
ALLTLVWIKROSI 

(30) Priority: 31.03.1997 US 828985 

(71) Applicant: 

Hewlett-Packard Company 
Palo Alto, California 94304 (US) 



(72) Inventors: 

• Oldfleld,BarryJ. 
Boise, ID 83713 (US) 

• Mejla, Roberta 
Boise, ID 83702 (US) 

(74) Representative: 

Schoppe, Fritz, DIpl.-lng. 
Schoppe & Zimmermann 
Patentanwdlte 
Postfach 71 08 67 
81458 Munchen (DE) 



(54) Fibre channel arbitrated loop dynamic loop sizing 

(57) In a Fibre Channel Arbitrated Loop communi- 
cations architecture (40.45), dynamic loop sizing 
includes selectively bypassing operational device ports 
(10,15.20.25.30,35) in the loop in order to minimize 
overhead associated with loop size. In redundant sys- 
tems with multiple loops, the system Is optimized by 
judicious distribution of the bypassed ports among the 
loops. Redundancy is at no point reduced. By bypass- 
ing unused or unneeded ports off of a loop, the round 
trip delay of the loop is appreciably shortened. By mini- 
mizing the round trip delay, arbitration overhead and 
access latency is reduced, and loop bandwidth and 
overall performance is improved. Dynamic load sharing 
balances the load between the dual loops when using 
dual ported devices on the loops. Dynamic load sharing 
is accomplished by bypassing a given subset of devices 
off each loop to reduce round trip delay; monitoring traf- 
fic on the loops; and controlling which devices are 
attached to which loop in order to balance the load 
across the loops. Dynamic system configuration fea- 
tures provide an optimized system configuration on a 
discretely continuous basis, including implementing 
dynamic loop sizing, dynamic load sharing, and manag- 
ing the interconnection of multiple loops and controllers. 
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Description 

FicinnFTHE INVENTION 

This invention relates In general to redundant sys- s 
terns and data communication architectures and. more 
particularly, to performance features of a fibre channel 
artMtrated loop in a redundant system. 



Rft r^KfiROUND OF THF INVENTION 



10 



Fibre Channel (FC) is a high speed serial communi- 
cations architecture for transmitting data from one com- 
munication port to a next (i.e., a point to point 
communication link). Data transfer rates on the order of is 
100 mega bytes per second (or 1 giga bits per second) 
are achievable. Devices, such as hard disks and con- 
trollers for Redundant Arrays of Inexpensive Disks 
(RAID controllers), have one or more communication 
ports that are attached to the FC links. Each port has an 20 
input and an output. The ports can be connected in a 
daisy chain configuration to form a loop over which com- 
munication transmissions are passed. Current stand- 
ards support up to 126 devices on the loop. In order to 
maintain order on the loop, a loop protocol, which 25 
includes an arbitration protocol, is used to determine 
which port (device) has control of the loop. This config- 
uration and loop protocol are known as a Fibre Channel 
Arbitrated Loop (FC-AL). 

In FC-AL each port examines the Incoming data (as so 
the data Is passed around the loop) to determine If any 
action is appropriate to be taken. Each port simply re- 
transmits the data if that port is not involved In the cur- 
rent activity. This data "checking" or "snooping" 
requires time and causes a significant amount of delay 35 
to be added between the input and output of the data at 
the port. These "port" delays in connection with 
"propagation " delays through the port-to-port communi- 
cation links add up to a round trip loop delay. The round 
trip loop delay is the time for data to travel from a port 's 40 
output around the loop and back to its input. Round trip 
loop delay is typically dominated by port delays. 

To gain control of the loop a port transmits a special 
packet of information known as an arbitration primitive. 
If the arbitration primitive can make a complete trip 45 
around the loop without a higher priority node substitut- 
ing its own arbitration primitive, the node wins control of 
the loop. In other words, if a port receives back the arbi- 
tration primitive it sent, it has won arbitration. In addition 
to gaining control of the loop, there is another round trip so 
of overhead Incurred for the port that won arbitration to 
make contact with the port with which It desires to com- 
municate. 

To protect loops from having a falling port (or 
device) cause a break in the loop, a routing device ss 
known as a port bypass circuit (PBC) is used. A PBC is 
a device that duplicates its received Input signal. One 
copy is sent to a multiplexer inside the PBC and the 
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other is driven on the loJRutput. The local" output 
of the PBC is connected to the Input of a respective 
port. The output of the port is connected to the 'locar 
input of the PBC which is also connected to the PBC's 
internal multiplexer. The output of the multiplexer is 
driven to the PBC's output which is connected to the 
next PBC on the arbitrated loop. 

When a node (device) is active and functional, the 
multiplexer in the PBC selects the local input from the 
port to drive the output to the rest of the loop. When the 
node Is dysfunctional or absent, the multiplexer will 
select the input directly from the input connected to the 
previous PBC. However, the data stream corning into 
the PBC is always provided to the port so th^t it can 
monitor the loop traffic for messages that may affect it. 
This is important since in some architectures the port 
has control over the multiplexer in Its associated PBC. 
When bypassed, however, the port does not drive data 
onto the loop. 

The delay through a port is more than 50 times the 
delay through a PBC in bypass mode. The port delay is 
also significantly larger than the delay associated with 
the interconnecting media between ports in typical an^ay 
applications. Thus, the more operational devices that 
are connected to a given FC-AL. the longer it takes for 
arbitration to occur and the higher the overtiead penalty 
Disadvantageously. the increased overhead reduces 
the available bandwkJth. 

Accordingly, an object of the present invention is to 
improve performance of a Fibre Channel Arbitrated 
l^p in a redundant system. 



RlJMf^ARY OF THE INVENTION 

According to principles of the present invention In a 
preferred embodiment, in a Rbre Channel Arbitrated 
Loop communications architecture, dynamic loop sizing 
includes selectively bypassing operational device ports 
in the loop in order to minimize overhead associated 
with loop size. In redundant systems with multiple loops, 
the system is optimized by judicious distribution of the 
bypassed ports among the loops. Redundancy is at no 
point reduced. By bypassing unused or unneeded ports 
off of a loop, the round trip delay of the loop is apprecia- 
bly shortened. By minimizing the round trip delay, arbi- 
tration overhead and access latency is reduced, and 
loop bandwidth and overall performance Is inrproved. 

According to further principles, dynamic load shar- 
ing balances the load between dual loops when using 
dual ported devices on the loops. Dynamic load sharing 
is accomplished by bypassing a given subset of devices 
off each loop to reduce round trip delay: monitoring traf- 
fic on the loops: and controlling which devices are 
attached to which loops in order to balance the load 
across the loops. 

According to yet further principles, dynamic system 
configuration features provide an optimized system on a 
discretely continuous basis, including implementing 
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dynamic loop sizing, dynamic toad sharing, and manag- 
ing the interconnection of multiple loops and controllers. 

Other objects, advantages, and capabilities of the 
present invention will become more apparent as the 
description proceeds. 

DESCRIPTION OF THE DRAWINGS 

Rg. 1 Is a block diagram of a Fibre Channel dual 
arbitrated loop system according to principles of the 
present invention. 

Rg. 2 is a block diagram of a port bypass operation. 

Rg. 3 is a block diagram of multiple hosts and 
devices in connection with a routing network for provid- 
ing a dyr^mically configurable art>itrated loop system. 

Fig. 4 is a flow diagram depicting a method of the 
present invention. 

DETAILED DESCRIPTION OF THE INVENTION 

Rg. 1 is a block diagram of a Rbre Channel dual 
arbitrated loop system according to principles of the 
present invention. Two host devices 1 0 and 15 are con- 
nected to four target devices 20. 25. 30. and 35 (20-35) 
via separate communication links (fflxe channel loops) 
40, 45 and via respective routing devices 50. 55. 60. 65. 
70. 75. 80. 85. 90, 95, 100. and 105 (50-105). Loops 40 
and 45 are capable of sustaining data communication 
transmissions as conventional in the art. In the example 
depicted and discussed, host devices 10 and 15 are 
controller boards for a disk system having communica- 
tion capabilities therebetween 17 for sharing control 
information, data and/or work load. The disk system 
includes disk drives (target devices) 20-35. The dual 
host devices 10 and 15 and dual loops 40 and 45 pro- 
vide redundancy of control and communication for 
improved system management and handling of device 
and communications failure. Preferably, disk devices 
20-35 are also configured to provide data redundancy, 
such as under a RAID 1 (mirror) or RAID 5 (par- 
ity/stripe) scheme, or a combination thereof. 

Each host and disk drive is a dual ported device for 
interconnecting with each of the dual fibre channel 
loops 40 and 45. Each routing device 50-105 is a port 
bypass circuit (PBC) for transmitting data from its 
respective loop to its respective target device and/or 
from the target device to the loop, and/or for causing the 
loop data transmissions to bypass the respective target 
device and to continue on around the loop to the next 
PBC. 

Each PBC 50-105 may bOf controlled by conven- 
tional multiplexing techniques for enabling bypassing of 
its respective port in the event of a disfunctional or 
absent port, and for having the port drive data onto the 
loop through tiie PBC in the event of a functional/active 
port. However, in addition to conventional PBC con- 
trol/functk}nality, conti-ol system 1 10 also directly con- 
trols the functionality of each PBC. Specifically. In a 



preferred embodiment, firmware and/or circuitry 115. 
120 in each host device 10, 15 also controls each PBC 
50-105 via control system 110. Control system 110 is 
any conventional electrical, optical, infrared, etc. con- 

5 nection between the host devices and each PBC. In a 
preferred embodiment, the control system is imple- 
mented as a communications channel separate from 
the aitMtrated kx>p. Alternatively, the control system is 
implemented via the arbitrated loop. 

10 Active links between devices (ports) and PBCs for 
each loop 40. 45 are designated with solid directional 
lines. A Ijarticipating port" (of a device) communicates 
with its loop via an active link. For example, vwth respect 
to loop 40, target devices 20 and 25 and host device 10 

15 are each shown communicating with the loop (i e-. sre 
participating ports) via PBCs 50. 55 and 70 respectively. 
The solid directional tines represent data flowing in the 
indicated direction for the respective loop, and further 
indicate that the respective device is receiving data from 

20 the loop and retransmitting the data back onto the loop 
under general FC-AL principles. All the active links for a 
given loop define the data transmission path for that 
respective bop. 

Inactive links are designated with dashed lines and 

25 each inactive link represents a 'bypassed port" status 
for the device. For example, with respect to loop 40. tar- 
get devices 30 and 35 and host device 15 are each 
shown as having inactive links with their ports being 
bypassed via PBCs 60, 65 and 75 respectively. A 

30 bypassed port does not drive data onto its loop. 
Although data may actually be passing from a device 
over the "dashed line" (inactive link) to the PBC, that 
data is not being passed through the PBC and is tiius 
not driven onto the loop. Rather, data received into that 

35 particular PBC from the previous PBC on the loop is 
transmitted directiy on to the next PBC in the loop. As 
mentioned, tiie multiplexor configuration witiiin the PBC 
detennlnes tiie data path. Thus, a 'bypassed port" Indi- 
cates that the device (port) is not retransmitting (i.e.. is 

40 not driving) data l>ack onto the loop. 

Rg. 2 more cteariy depicts a port bypass operation. 
As an example, device 130 is connected via its port to 
PBC 140, and PBC 140 is connected to fibre channel 
loop 170. Device 135 is connected via Its port to PBC 

45 145, and PBC 145 is also connected to the loop. 
Because of the multiplexor configuration 142 within 
PBC 140. device 130 is considered to have an "active 
link" with respect to PBC 140 and loop 170. Namely, 
data received from tiie loop through link 1 60 is transmit- 

50 ted tiirough device 130 (its port) and then back tiirough 
link 150 to PBC 140 and ultimately back onto the loop 
170. In contiBSt, device 135 has an "inactive link" (rep- 
reserited by dashed directional line 155) with respect to 
PBC 145 and loop 170. The inactive link represents that 

55 data is not being driven onto the loop from device 135. 
Ratiier. data is transmitted into PBC 145 directiy from 
loop 170 and then, due to the multiplexor configuration 
147 of PBC 145. transmitted straight tiirough PBC 145 
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and on down the loop. 

Accordingly, the data transmission delay time 
between points "A" and "B " on loop 1 70 (with respect to 
the "active link" 150 of device 130) is at least 50 times 
the delay between points and "D" (with respect to 
Inactive link" 155). Thus, it is easily seen that data 
transmission delay is dramatically reduced if the data 
can be forced to bypass a given device on a loop. 

Referring again now to Rg. 1, an object of the 
present invention is to reduce total round trip delay for a 
given loop by reducing the overhead associated with the 
loop size. This is acconplished in a redundant system 
environment by bypassing selected ports on the loop 
according to dynamic loop sizing schemes and, prefer- 
ably, by implementing dynamic system configuration 
and load sharing schemes. 

Under the present invention, selected subsets of 
normally operational ports (or devices) in a redundant 
system are bypassed to improve overall system per- 
formance and efficiency without losing the desired 
redundancy of the system. The system is optimized by 
judicious distribution of the ports among the loops. For 
exarrple, in Rg. 1 , with respect to loop 40, the ports of 
target devices 30 and 35 are bypassed at PBC 60 and 
65 respectively (identified by the dashed lines and refer- 
ence wording), and the port of host device 15 is 
bypassed at PBC 75. On the other hand, with respect to 
loop 45. the ports of target devices 20 and 25 are 
bypassed at PBC 80 and 85 respectively, and the port of 
host device 10 is bypassed at PBC 100. TTius, in this 
example, half the ports on each loop are bypassed, 
even though the devices are operational, but redun- 
dancy is maintained in the event of failure in a loop or 
device. For exanple. if loop 45 fails, PBCs 60 and 65 
are reconfigured to provide active links to target devices 
30 and 35 such that they become participating ports on 
loop 40. 

Again, the removing of selected subsets of ports of 
operational devices from the loop by activating their 
respective PBCs effectuates a dynamic loop sizing 
scheme whereby Rbre Channel arbitrated loop (FC-AL) 
performance is improved. As discussed, this is effective 
because a bypassed port inserts less delay into the loop 
than does an active port The delays from all of the ports 
in the loop combine to fonm the loop's round trip delay 
As well known, the round trip delay must be traversed 
several times in the process of arbitrating for the loop 
and establishing a connection between a pair of ports 
that wish to communicate. By reducing the round trip 
delay under the present invention, the overhead from 
arbitration and for the establishing of a connection is 
reduced. This clearly improves throughput (l/0*s per 
second) and bandwidth (Mbytes per second) of the 
loop. 

As mentioned, firmware/circuitry 115, 120 of host 
devices 10. 15 control activation of the PBCs via control 
system 1 10 to implement the specific configuration that 
defines which ports are bypassed for the respective 



operational target devices. This control is used in con- 
junction with conventional multiplexor bypassing of a 
port in the event of a disfunctional and/or inoperational 
device. Significantly, however, redundancy capability is 
s at no point reduced. The only penally fs that the proper 
loop must be chosen in order to access a particular tar- 
get device. 

In the evem a specific target device is not opera- 
tional, conventional bypass of a port may occur at its 

10 respective PBC without intervention from host controller 
devices 10, 15. However, upon detection of such a fail- 
ure, dynamic system reconfiguration may, optionally, 
occur again to best configure whtich ports are to be 
bypassed for the respective remairting operational tar- 

15 get devices to best balance load sharing among the 
devices. 

As mentioned, dynamic load sharing balances the 
load as between dual loops when using dual ported 
devices on the loops, and as between multiple loops 

20 when more than two loops are used. The first step for 
toad sharing includes bypassing selected de\^ces off of 
each loop (for example, half, as illustrated in Fig. 1). The 
effect of tiiis is to make the round tr^ delay and arbitra- 
tion overhead smaller for each loop thus improving the 

25 overall throughput of the system. The second step 
involves monitoring traffic on the loops and controlling 
which devices are attached to which loop in order to bal- 
ance the load across the loops. Intelligent control of 
load sharing is also advantageous. One example of this 

30 is to maintain one loop as a low node coum loop with 
tower latency and more available bandwidth for high pri- 
ority traffic and. simultaneously, maintain the other loop 
as a high node count loop with greater connectivity but 
with longer latency and less available bandwidth for 

35 tower priority traffic. Various other configurations are 
also feasible, depending on traffic monitored and 
resources available. 

Referring now to Fig. 3. the block diagram shows 
how the present invention is dearly not limited to a dual 

40 toop/controller implementation (as discussed in refer- 
ence to Rg. 1). Rather. Fig. 3 depicts how the invention 
is equally applicable to a system embodying multiple 
host controllers CI. C2. and C3 through CN (Cl-CN) 
and multiple target devices B1. B2, B3, B4 and B5 

45 through BN {B1-BN) in connection with a routing 
(switching) network 250 for providing a dynamically con- 
figurable arbitrated multi-loop system. Routing network 
250 has two bi-directional connections for each control- 
ler Cl -CN and each target device B1 -BN. 

50 In this example, each target device (drive box or 
enclosure) B1-BN contains multiple disk mechanisms 
with dual arbitrated loop segments connected to each of 
the disk mechanisms' dual ports. For example, drive 
box B1 depicts four disk drives D 1 , D2, D3 and D4 (D1 - 

55 D4) connected to loops 255 and 260 via PBCs 265 and 
270 respectively The disk mechanism/loop configura- 
tion of B1 Is similar to that of Rg. 1. The detail configu- 
ration for the other drive boxes B2-BN is not shown to 
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simplify the drawing. However, each drive box B2-BN 
may be configured similar to drive box B1 , or each may 
be configured differently, such as with more or less 
drives or different sized drives (albeit in a prefen-ed 
embodiment each drive is dual ported and connected 5 
to dual loops via respective PBCs). 

Each drive box B1-BN is attached to routing net- 
work 250 through respective links (ports). Namely, drive 
box B1 connects to.routing network 250 via links B1L0 
and B1 LI , and drive box B2 connects to routing network 10 
250 via links B2L0 and B2L1, and so forth. These 
links/ports will be refen-ed to as B1L0-BNL1. Similarly, 
host/controller dewces C1-CN connect to routing net- 
work 250 via respective links. For example. C1 connects 
via links C1L0 and CI LI, and C2 connects via links is 
C2L0 and C2L1. and so forth. These links/ports will be 
referred to as CI LO-CNLI. 

Routing network 250 is any conventional routing 
network that is capable of interconnecting any subset or 
all of ports C1L0-CNL1 to any subset or all of ports 20 
81 L0-BNL1 . Specifically, routing network 250 connects 
any host/controller (or any multiple controllers) C1-CN 
with any drive box (or multiple boxes) B1-BN via the 
respective links C1L0-CNL1 and B1 L0-BNL1 . As such, 
multiple arbitrated loop configurations are achievabi e by 25 
connecting different controllers to different ports on dif- 
ferent devices. Moreover, by selectively bypassing dif- 
fering disk drive units (i.e., D1-D4) in the differing drive 
boxes B1-BN, dynamic loop sizing occurs to minimize 
overhead associated with each loop estat^ished. Again, 30 
redundancy is maintained and the system is optimized 
by judicious distribution of the bypassed ports among 
the loops. To this regard, the way in which all of the con- 
nections are made at any given moment during system 
operations can have a significant bearing on overall sys- 35 
tern performance. Accordingly, the optimal system con- 
figuration is not static but will vary with system loading 
conditions (as previously discussed with regard to 
dynamic load sharing). There are also upgrade, expan- 
sion and/or modification considerations, such as for the 40 
addition and/or removal of devices, controllers and/or 
loops, that affect overall system performance and 
dynamic system reconfiguration parameters. 

In essence, a dynamic system configuration 
includes applying intelligent control to routing network 45 
250 in order to optimize the system configuratton on a 
discretely continuous basis. In one embodiment, the 
intelligent control is operat)le via firmware/circuitry in the 
host controllers Cl-CN (see 115. 120 of Fig. 1). The 
intelligent control involves dynamic loop sizing, dynamic so 
toad sharing, and management of the interconnection of 
multiple loops and controllers. Proper control and topol- 
ogy preserves the redundancy of the system. For exam- 
ple, a topology is easily configured between controllers 
C1 and C2 and drive boxes B1 and 82 that creates dual ss 
arbitrated loops and judiciously distributed disk mecha- 
nisms on those loops, similar to the example of Fig. 1. 
On the other hand, many other scenarios are also work- 



able. For exanpie. if three controOers CI -C3 are utilized 
in connection with two drive boxes 81 and 82, then one 
possible multi loop configuration is as follows: 

loop A" 81U).C1U)andC3U) 

lOQpB" 81 LI and CI L1 

toc^C- 82L0.C2L0andC3LJ0 

loop D - B2L1 and C2L1 

The odd number of controllers creates an uneven distri- 
bution Of controllers on the loops. However, the PBCs 
(i.e.. 265, 270, etc.) are then adjusted to produce a 
skewed distribution of drives on the loops In response to 
the controller bandwidth on each of the loops and their 
traffic patterns. For exanpie, one possible optimization 
might be to place more drives onto loops A and B since 
there are more controller resources available on these 
loops. Another might be to place fewer drives on loops 
A and 8 so that they can be very responsive while loops 
C and D are used for less frequently accessed data. 
Another exemplary multi-loop configuration maybe: 

loop A" C1L0,B1U)andB2U) 

loopB- C1L1,83L0andB4LO 

loop C - C2L0. B1 LI and B2L1 

loop D - C2L1 . B3L1 and B4L1 

This configuration defines two controllers CI and 
C2 with four drive boxes B1, 82. B3 and B4, and four 
loops. 

Obviously, various other loop configurations and 
drive bypass schemes are also feasible. 

Rnally, routing networtt 250 allows for the on-line • 
addition/deletion of controllers and/or target devices; 
provides a mechanism for enabling smart or dynamic 
configuration of resources and art^'tration kwps; and 
provides for enabling features such as: (i) removing sys- 
tem configuration knowledge requirements from a 
user's perspective; (ii) automatically adapting system 
configurations to match work load or fault conditions; 
(ili) providing remote administration for adaptive system 
configurations; and (iv) enhandng system diagnostics. 

Referring rrow to Fig. 4, a ftow diagram depicts a 
preferred method of the present invention. First system 
resources are identified 200. This includes all target 
devices, respective PBCs, host/controller devices, and 
type of routing network for building loops among the 
devices. Moreover, in the event the target devices are 
disk drives, for example, criteria such as storage capac- 
ities, access speeds. RAID schemes, etc. are consid- 
ered. Next. 205, a redundant system is oonf igured using 
the routing network (i.e., nujltiple toops are established) 
and based on the kJentif ied resources available. Then, 
210. sii)sets of ports are identified on each loop that 
are to be bypassed while keeping system redundancy. 
These are identified per criteria such as number of 
loops, number of target devices and controller devices, 
load balancing schemes, etc. Again, for example, in the 
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event the target devices are disk drivesTriteria such as 
storage capacities, access speeds, RAID schemes, etc. 
are considered. Once the subsets of devices are identi- 
fied on each loop, then those ports are inactivated 215 3. 
via their respective PBCs to establish a communication 5 
transmission path on each loop which is reduced in data 
transmission round trip delay time relative to the entire 
number of operational and/or dysfunctional devices on 4. 
the loop. The system is now ready for normal opera- 
tions. 10 

Next, if a communication transmission is requested 
by/to a device 220. then the loop on which the device is 
located is identified 225, and communications are ena- 5. 
bled via that loop 230 (i.e., arbitration begins and data 
transfer occurs). Communication traffic is monitored is 
235 so that load balancing may be optimized. Similarly, 
resources are monitored so that system configurations 
may be dynamically configured relative to loop paths, 
loop sizing and load sharing as previously discussed. If 6. 
system changes occur 240, dynamic reconfiguration 20 
may again occur to provide optimized redundancy, per- 
formance and/or efficiency. 

Finally, what has been described above are the pre- 
ferred embodiments of a system and method for improv- 
ing the performance of a Fibre Channel arbitrated loop 25 7. 
in a redundant system. While the present invention has 
been described by reference to specific embodiments, it 
will be apparent that other alternative emtKxIiments and 
methods of Implementation or modification may be 
enployed without departing from the true spirit and 30 
scope of the invention. 

Claims 



(40,45) provide point 
loop topology 



# 



point communication in a 



The communication system of claim 1 or 2 wherein 
each communication link (40,45) is a separate f ibre 
channel art)itrat6d loop. 

The communication system of daim 2 or 3 wherein 
the bypass of each subset reduces a round trip 
delay of the communication transmissions relative 
to the loop topology. 

The communication system of claim 1, 2. 3 or 4 
wherein the first (60,65) and second (80,85) sub- 
sets of target devices are defined to provide load 
sharing among the plurality of target devices and 
communication links. 

The communication system of daim 1, 2, 3, 4 or 5 
wherein the first (60,65) and second (80,85) sub- 
sets of target devices are defined to inprove effi- 
dency of communication transmissions among the 
plurality of target devices and communication links. 

The communication system of daim 1 , 2. 3, 4, 5 or 
6 wherein the at least first and second communica- 
tion links (40,45) in combination provide a redun- 
dancy configuration for communication 
transmissions between tiie at least first host device 
(10) and plurality of target devices (20,25,30,35) for 
failover operations and for dynamic management of 
communication transmissions relative to the com- 
munication links and plurality of target devices. 



1 . A communication system comprising : 35 

(a) at least a first and a second communication 
link (40.45) interconnecting at least a first host 
device (10) with a plurality of target devices 
(20,25,30.35) via routing devices 40 
(50.55.60,65.70.80,85.90,95.100). the commu- 
nication links being capable of sustaining com- 
munication transmissions; and, 

(b) control apparatus (110,115) for controlling 
the routing devices such that the communica- 45 
tion transmissions bypass a first subset of the 
target devices (60,65) relative to the first com- 
munication link (40), and bypass a second sub- 
set of the target devices (80.85) relative to the 
second communication link (45). wherein each so 
subset indudes at least one operational target 
device, and wherein each subset is configured 

to be bypassed during normal communication 
system operating conditions for improved sys- 
tem performance. ss 

2. The communication system of claim 1 wherein the 
at least first and second communication links 



8. The communication system of claim 1, 2. 3. 4. 5. 6 
or 7 wherein the control apparatus (110.115) con- 
trols the routing devices 
(50,55.60,65.70.80.85,90,95.100) such that a given 
operational target device (20) of tiie plurality of tar- 
get devices (20,25,30,35) is not bypassed on a 
given one of tiie communication links (40) in the 
event the given target device (20) is bypassed on 
the other of the communication links (45). 

9. The communication system of claim 1 , 2, 3, 4, 5, 6, 
7 or 8 furtiier induding reconfiguration apparatus 
(115,120,250) for dynamically reconfiguring com- 
munication links (40.45) and subsets of devices 
(20,25,30,35). 

10. The communication system of claim 9 wherein the 
reconfiguration apparatus (115,120,250) dynami- 
cally reconfigures tiie communication links (40,45) 
and subsets of devices (20.25,30,35) based on 
selected parameters, including, optionally, commu- 
nication system operational efficiency, performance 
and failover objectives, and system growth or 
reduction in devices. 
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11. The communication system^W claim 9 or 10 
wherein the reconfiguration apparatus for dynami- 
cally reconfiguring the communication links and 
subsets of devices comprises a routing network 
(250) and control intelligence (1 15.120) for config- 5 
uring loops and bypassing devices. 



12. A method for improving performance in a redundant 
communication system having at least one control- 
ler device (10), a plurality of target devices 10 
(20,25.30.35), a respective plurality of routing 
devices (50,55.60,65.70.80.85.90.95.100). and at 
least two communication links (40.45) interconnect- 
ing the at least one controller device and target 
devices via the routing devices, the method com- is 
prising the steps of: 



(a) establishing a communication transmission 
path (205) for each communication link (40.45) 
such that a sid3set of target devices particular 20 
to each link are bypassed via the respective 
routing devices, each subset including at least 
one operational target device, and wherein 
each subset is bypassed during normal com- 
munication system operating conditions for 25 
improved system performance; and. 

(b) enabling communication transmissions to a 
selected target device via the respective com- 
munication link for which the selected target 
device is not bypassed. so 



1 3. The method of claim 1 2 wherein the communication 
links (40.45) provide point to point communication 
in a loop topology and wherein the bypassing of 
each subset reduces a round trip delay of the com- 35 
munication transmissions relative to the loop topol- 
ogy. 

14. The metiiod of daim 12 or 13 furtiier including 
dynamically altering (240.200.205.210,215) the 40 
communication transmission path for one or more 

of the communication links such that a different 
subset or subsets of target devices (20,25,30,35) 
are bypassed. 

46 

15. The metfiod of claim 12. 13 or 14 furtiier including, 
optionally, dynamically altering the communication 
transmission patii for one or more existing commu- 
nication links, or for one or more existing communi- 
cation links in connection with (i) the addition of one so 
or more new communication links or (ii) the removal 

of one or more communication links, based on 
selected parameters, including, optionally, commu- 
nication system operational efficiency, performance 
and failover objectives, and system growtii or ss 
reduction in devices. 
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